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Abstract 

We study the joint source-channel coding problem of transmitting a discrete-time analog source over an additive 
white Gaussian noise (AWGN) channel with interference known at transmitter. We consider the case when the source 
and the interference are correlated. We first derive an outer bound on the achievable distortion and then, we propose 
two joint source-channel coding schemes. The first scheme is the superposition of the uncoded signal and a digital 
part which is the concatenation of a Wyner-Ziv encoder and a dirty paper encoder. In the second scheme, the digital 
part is replaced by the hybrid digital and analog scheme proposed by Wilson et al. When the channel signal-to- 
noise ratio (SNR) is perfectly known at the transmitter, both proposed schemes are shown to provide identical 
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performance which is substantially better than that of existing schemes. In the presence of an SNR mismatch, 
both proposed schemes are shown to be capable of graceful enhancement and graceful degradation. Interestingly, 
unlike the case when the source and interference are independent, neither of the two schemes outperforms the other 
universally. As an application of the proposed schemes, we provide both inner and outer bounds on the distortion 
region for the generalized cognitive radio channel. 

Index Terms 

Distortion region, joint source-channel coding, cognitive radios. 

I. Introduction and Problem Statement 

In this paper, we consider transmitting a length-n i.i.d. zero-mean Gaussian source V n = (V(l), V(2), . . . , V(n)) 
over n uses of an additive white Gaussian noise (AWGN) channel with noise Z n ~ A/"(0, N ■ I) in the 
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presence of Gaussian interference S n which is known at the transmitter as shown in Fig. \T\ Throughout 
the paper, we only focus on the bandwidth-matched case, i.e., the signalling rate over the channel is equal 
to the sampling rate of the source. The transmitted signal X n = (X(i), X(2), . . . ,X(n)) is subject to a 
power constraint 

1 n 

-]Te[X(*) 2 ]<P, (1) 

i=l 

where E[-] represents the expectation operation. The received signal Y n is given by 

Y n = X n + S n + Z n . (2) 

We are interested in the expected distortion between the source and the estimate V n at the output of 
the decoder given by 

d = E[d(V n , g(f(V n , S n ) + S n + Z n ))}, (3) 

where / and g are a pair of source-channel coding encoder and decoder, respectively, and d(., .) is the 
mean squared error (MSE) distortion measure given by 

1 - 

d(v,v) = -j2(v^-m 2 - (4) 

i=l 

Here the lower case letters represent realizations of random variables denoted by upper case letters. As in 
JT), a distortion D is achievable under power constraint P if for any e > 0, there exists a source-channel 
code and a sufficiently large n such that d < D + e. 

When V and 5" are uncorrected, it is known that an optimal quantizer followed by a Costa's dirty 
paper coding (DPC) [2] is optimal and the corresponding joint source-channel coding problem is fully 
discussed in [3]. However, different from the typical writing on dirty paper problem, in this paper, we 
consider the case where the source and the interference are correlated with a covariance matrix given by 

/ (Jy pOyO S 

Ays = I 

Y pOyO S <J% 

Under this assumption, separate source and channel coding using DPC naively may not be a good 
candidate for encoding V n in general. It is due to the fact that in Costa's DPC scheme, the transmitted 
signal is designed to be orthogonal to the interference and, hence, the DPC scheme cannot exploit the 
correlation between the source and the interference. Also, the purely uncoded scheme fails to avoid 
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the interference and is suboptimal in general. In this paper, we first derive an outer bound on the 
achievable distortion region and then, we propose two joint source-channel coding schemes which exploit 
the correlation between V n and S n , thereby outperforming the naive DPC scheme. The first scheme is a 
superposition of the uncoded scheme and a digital part formed by a Wyner-Ziv coding [4] followed by 
a DPC, which we refer to as a digital DPC based scheme (or just the digital DPC scheme). The second 
scheme is obtained by replacing the digital part by a hybrid digital and analog (HDA) scheme given in 
||3l that has been shown to provide graceful improvement when the actual SNR (SNR a ) is better than 
the design SNR (SNR^). We then analyze the performance of these two proposed schemes when there 
is an SNR mismatch. It is shown that both the HDA scheme and the digital DPC scheme benefit from 
a higher channel SNR and provide graceful enhancement; however, interestingly, for this case neither of 
schemes dominate the other universally and which one performs better depends on the designed SNR. 
When p is small, the HDA scheme outperforms the digital DPC scheme and when p is large, the digital 
DPC scheme outperforms the HDA scheme. When the channel deteriorates, both the proposed schemes 
perform identically and are able to provide graceful degradation. 

One interesting application of this problem is to derive an achievable distortion region for the generalized 
cognitive radio channel with correlated sources. This channel can be modeled as a typical two-user 
interference channel except that one of them knows exactly what the other plans to transmit. Moreover, 
two users' sources are assumed to be correlated. One can regard the informed user's channel as the setup 
we consider here and then directly apply the schemes we propose as the coding scheme for the informed 
user. For the generalized cognitive radio channel with correlated sources, we provide inner and outer 
bounds on the distortion region where the inner bound largely relies on the coding schemes proposed in 
this paper. 

The rest of the paper is organized as follows. In Section HH we present some prior work which is 
closely related to ours. The outer bound is given in Section [HI] and two proposed schemes are given in 
Section [IV] In Section |Vl we analyze the performance of the proposed schemes under SNR mismatch. 
These proposed schemes are then extended to the generalized cognitive radio channel in Section |VIJ Some 
conclusions are given in Section IVIIl 

II. Related Work on JSCC with Interference Known at Transmitter 

In 0, Sutivong et al. consider the problem of sending a digital source in the presence of interference 
(or, channel state) which is known at the transmitter and is assumed to be independent of the source. 
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The optimal tradeoff between the achievable rate for transmitting the digital source and the distortion in 
estimating the interference is then studied. A coding scheme that is able to achieve the optimal tradeoff 
is also provided in j5]|. This coding scheme uses a portion of the power to amplify the interference and 
uses the remaining power to transmit the digital source via DPC. This coding scheme can be extended 
to the problem we consider as follows. Since the source and the interference are jointly Gaussian, we 
can first rewrite the source as V = p^S + N' p with S and the innovation N' p being independent of 
each other. Now if one quantizes N' into digital data, the setup becomes the one considered by Sutivong 
et al. and their proposed scheme can be applied directly. For any power allocation between the analog 
part and digital part, using this scheme to operate on the boundary of the optimal tradeoff, the optimal 
distortion in estimating p^S and that in estimating N' p is achieved. The distortion in estimating V for 
this power allocation strategy is the sum of the above two distortions. One can then optimize the power 
allocation strategy to get the minimum distortion for this coding scheme. It is worth pointing out that 
this coding scheme is in general suboptimal for our problem although it achieves the optimal tradeoff 
between estimating S and N' p individually. This is because, our interest is in estimating V directly and it 
is importantly to carefully take advantage of the correlation in the estimation error in estimating S and 
N'. The coding scheme in jH is not naturally suited to take advantage of this correlation. One numerical 
example is shown in Fig. [2] where we can see that the union of the uncoded scheme and the naive DPC 
scheme outperforms the extension of Sutivong et a/.'s scheme. 

In |[6l, Lapidoth et al. consider the 2x1 multiple access channel in which two transmitters wish to 
communicate their sources, which are drawn from a bi-variate Gaussian distribution, to a receiver which 
is interested in reconstructing both sources. There are some similarities between the proposed work and 
the work in [6| if we regard one of the users', say the user 2's, signal as interference. However, an 
important difference is that in H, the transmitters are not allowed to cooperate with each other, i.e., for 
the transmitter 1, the interference (user 2's signal) is not known. Moreover, this interference now depends 
on the signalling scheme adopted at user 2 and may not be correlated to the source anymore. 

In fTl- ffTOll , transmitting a bi-variate Gaussian source over a 1 x 2 Gaussian Broadcast Channel is 
considered. In their setup, the source consists of two components V™ and which are memoryless 
and stationary bi-variate Gaussian random variables and each receiver is only interested in one part of 
the sources. In IfTOl , Tian et al. propose a HDA scheme that achieves the outer bound given in and 
therefore leads to a complete characterization of the distortion region. This problem is similar to ours if 
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we only focus on one receiver, say the first receiver. However, a crucial difference is that the interference 
now is a function of V£ which depends on the broadcast encoding scheme and may not be correlated 
to V™. The joint source-channel coding problem for broadcasting a single memoryless Gaussian source 
under bandwidth mismatch is considered in IfTlTl - lfTSI . However, different from its bandwidth matched 
counterpart 11241 . only approximation characterizations of the achievable distortion region are available 
for this problem. Broadcasting a colored Gaussian source over a colored Gaussian broadcast channel to 
a digital receiver and a analogy receiver is considered in Ifl4l where Prabhakaran et al. propose a HDA 
scheme that achieves the entire distortion region for the problem they consider. 

Joint source-channel coding for point to point communications over Gaussian channels has also been 
widely discussed. See e.g. ||3l, [[T5l - lfT7l . However, they either don't consider interference ( [fT5l - lfT71 ) or 
assume independence of source and interference ([3]). In [3], Wilson et al. proposed a HDA coding scheme 
for the typical writing on dirty paper problem in which the source is independent of the interference. This 
HDA scheme was originally proposed to perform well in the case of a SNR mismatch. In (3), the authors 
showed that their HDA scheme not only achieves the optimal distortion in the absence of SNR mismatch 
but also provides gracefully degradation in the presence of SNR mismatch. In the following sections, we 
will discuss this scheme in detail and then propose a coding scheme based on this one. 



A. Outer Bound 1 

For comparison, we first present a genie-aided outer bound. This outer bound is derived in a similar 
way to the one in [9] in which we assume that S n is revealed to the decoder by a genie. Thus, we have 



III. Outer Bounds 




h(Y n \S n ) - h(Y n \S n ,V n ) 



= h{X n + Z n \S n ) - h(Z n ) 



< h{X n + Z n ) - h{Z n ) 




(6) 



where (a) follows from the rate-distortion theorem [1], (b) is from the data processing inequality, (c) is 
due from that conditioning reduces differential entropy and (d) comes from the fact that Gaussian density 
maximizes the differential entropy and all random variables involved are i.i.d. Therefore, we have the 
outer bound as 

- 1 + p/N ■ (V) 

Note that this outer bound in general may not be tight for our setup since in the presence of correlation, 
giving S n to the decoder also offers a correlated version of the source that we wish to estimate. For 
example, in the case of p = 1, giving S n to the decoder implies that the outer bound is D ob = no 
matter what the received signal Y n was. On the other hand, if p = 0, the setup reduces to the one with 
uncorrelated interference and we know that this outer bound is tight. Now, we present another outer bound 
that improves this outer bound for some values of p. 

B. Outer Bound 2 

Since S(i) and V(i) are jointly Gaussian distributed with covariance matrix given in ©, we can write 

S(i)=p^V(i) + N p (i), (8) 

where N p (i) ~ A/"(0, (1 — p 2 )<J 2 s ) representing the innovation and is independent to V(i). Now, suppose 
a genie reveals only the n-letter collection of innovation iV™ to the decoder, we have 

n a v n var(V\N p ) 
— log v = — log 



2 -D fe,2 2 Dob 

W , - , , 

< I(V n ;V n \N^) 

< I(V n ;Y n \N^) 

= h{Y n \N r p l ) - h(Y n \N£,V n ) 

= h(X n + p—V n + Z n \N™) - h(Z r 

< h{X n + p—V n + Z n ) - h{Z n ) 

cry 



< - lot , 

~ 2 I N 

<-log 1 + ^ j^-^l- (9) 
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where (a)-(d) follow from the same reasons with those in the previous outer bound and (e) is due from 
the Cauchy-Schwartz inequality that states that the maximum occurs when X and V are collinear. Thus, 
we have 



step (a) does not decrease the knowledge about S n at the transmitter since S n is a deterministic function 
of V n and N™. 

Remark 1: If p — 0, this outer bound reduces to the previous one and is tight. If p — 1, the genie 
actually reveals nothing to the decoder and the setup reduces to the one considered in [5], i.e., the encoder 
is interested in revealing the interference to the decoder. For this case, we know that this outer bound 
is tight. However, this outer bound is in general optimistic except for two extremes. It is due to the fact 
that in derivations, we assume that we can simultaneously ignore the iV™ and use all the power to take 
advantage of the coherent part. Despite this, the outer bound still provides an insight that in order to build 
a good coding scheme that one should try to use a portion of power to make use of the correlation and 
then use the remaining power to avoid N 1 }. Further, it is natural to combine these two outer bounds as 
D ob = m&x{D obA , D ob)2 }. 

From now on, since the channel we consider is discrete memoryless and all the random variables we 
consider are i.i.d. in time, i.e. V(i) is independent of V(j) for i ^ j, we will drop the index i for the 
sake of convenience. 



A. Digital DPC Based Scheme 

We now propose a digital DPC scheme which retains the advantages of the above two schemes. This 
scheme can be regarded as an extended version of the coding scheme in [fT6l to the setup we consider. 
As shown in Fig. [31 the transmitted signal of this scheme is the superposition of the analog part X a with 
power P a and the digital part X d with power P — P a . The motivation here is to allocate some power for 
the analog part to make use of the interference which is somewhat coherent to the source for large p's 
and to assign more power to the digital part to avoid the interference when p is small. The analog part is 




(10) 



Note that although the encoder knows the interference S n exactly instead of just N™, the inequality in 



IV. Proposed Schemes 
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the scaled version of linear combination of source and interference as 

X a = v^( 7 y + (1-7)5-), (11) 

where P a e[0,P],a = P a /(r 2 a , 7 G [0, 1] and 

°l = l 2 °l + (! - 7) 2 4 + 2 7 (1 - 7 W<7 5 . (12) 

The received signal is given by 

Y = X d + X a + S + Z 

= X d + + (1 + v^(l - 7)) 5 + Z 

= X d + S' + Z, (13) 

where X d is chosen to be orthogonal to S and V" and S' = ^fa^V + (1 + y/a(l — 7)) S is the effective 
interference. The receiver first makes an estimate from Y only as V = (3Y with 

E[y Y] V^{l a v + (1 - 7 )p°vcrs) + po"yO"s 



y ~~ E[Y 2 ] P + N + a 2 + +2y/E((l - 7 )4 + ipoyos) ' 
The corresponding MSE is 

D* = a 2 v - /3E[VY] 



(14) 
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1 - /* (Wr + (1 - 1)P— ) + P— ) 
V °V cry / 



(15) 



Thus, we can write V = V + W with ~ jV(0, £>*). 

We now refine the estimate through the digital part, which is the concatenation of a Wyner-Ziv coding 
and a DPC. Since the DPC achieves the rate equal to that when there is no interference at all, the encoder 
can use the remaining power P — P a to reliably transmit the refining bits T with a rate arbitrarily close 
to 

* = ±log(i + ^). (16) 

The resulting distortion after refinement is then given as 

D* 

D sep = mf p_ p . (17) 
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In Appendix HH for self-containedness, we briefly summarize the digital Wyner-Ziv scheme to illustrate 
how to achieve the above distortion. 

It is worth noting that setting 7 = 1 gives us the lowest distortion always, i.e., super-imposing S onto 
the transmitted signal is completely unnecessary. However, it is in general not true for the cognitive radio 
setup. We will discuss this in detail in section |VIJ 

Remark 2: Different from the setup considered in [16J that the optimal distortion can be achieved by 
any power allocation between coded and uncoded transmissions, in our setup the optimal distortion is in 
general achieved by a particular power allocation which is a function of p. 

B. HDA Scheme 

Now, let us focus on the HDA scheme obtained by replacing the digital part in Fig. [3] by the HDA 
scheme given in [3J. The analog signal remains the same as in (flTT) and the HDA output is referred to 
as Xh- Therefore, we have Y = Xh + S' + Z. Again, the HDA scheme regards 5" as interference and 
V described previously as side-information. The encoding and decoding procedures are similar to that in 
but the coefficients need to be re-derived to fit our setup (the reader is referred to for details). 

Let the auxiliary random variable U be 

U = X h + aS' + kV, (18) 

where X h ~ jV(0, Ph) independent to S' and V and Ph = P — P a - The co variance matrix of S' and V 
can be computed by ©. 

Codebook Generation: Generate a random i.i.d. codebook U with 2 nRl codewords, reveal the codebook 
to both transmitter and receiver. 

Encoding: Given realizations s' and v, find au£W such that (s', v, u) is jointly typical. If such a u 
can be found, transmit x h = u — as' — tsv. Otherwise, an encoding failure is declared. 

Decoding: The decoder looks for a u such that (y, v', u) is jointly typical. A decoding failure is declared 
if none or more than one such u are found. It is shown in (31 that if n — > 00 and the condition given in 
(I2TI) is satisfied, the probability of u ^ u -> 0. 

Estimation: After decoding u, the receiver forms a linear MMSE estimate of v from y and u. The 
distortion is then obtained as 

Dhda = inf [4 - T T A^r] , (19) 



10 

where A UY is the covariance matrix of U and Y, and T = \E[VU], K[VY]] T . 

In the encoding step, to make sure the probability of encoding failure vanishes with increasing n, we 
require 

R x > I(U; S', V) 

= h{U) - h(X h + aS' + kV\S', V) 
{ = } h(U) - h(X h ) 

where (a) follows because X h is independent of S' and V. 

Further, to guarantee the decodability of U in the decoding step, one requires 

Ri </([/; Y,V) 

= h(U) - h{U\Y,V) 

= h(U) - h(U -aY - kV'\Y, V) 

i h(U) -h(nW + (l-a)X h -aZ\Y), (21) 

where (a) follows from the error analysis of £3 in Section III of [18| and (b) is due to the fact that 
V = f3Y. By choosing 

p p 2 

n - h k 2 - h (22) 

P h + N> (P h + N)D*> {ZZ) 

one can verify that (|20l) and (|2TT) are satisfied. Note that in (T20l) what we really need is Ri > I{U ; S', V)+e 
and in ((2T)) it is R\ < I(U; Y, V) — 5. However, since e and 5 can be made arbitrarily small, these are 
omitted for the sake of convenience and to maintain clarity. 

Remark 3: It is shown in Appendix [A] that the distortions in (TTvT) and (fT9l) are exactly the same. 
However, as we will see in the next section, two schemes perform differently when SNR a > SNR^. 

C. Numerical Results 

In Fig. HI we plot the distortion (in — 101og 10 (D)) for coding schemes and outer bounds described 
above as a function of SNR. In this figure, we set a 2 , = a 2 s = 1 and p = 0.3. Note that for this choice of 
<jy, what we plot is actually the signal-to-distortion ratio. As expected, the two proposed schemes have 
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exactly the same performance. Moreover, for this case, these two schemes not only outperform others but 
also approach the outer bound (maximum of two) very well. 

We then fix the SNR and plot the distortion as a function of p in Fig. |5] The parameters are set to be 
Gy = cr| = 1, P = 10, and N = 1. It can be seen that both the proposed schemes perform exactly the 
same and that the achievable distortion region with the proposed scheme is larger than what is achievable 
with a separation based scheme using DPC and a uncoded scheme. Further, although the proposed schemes 
perform close to the outer bound over a wide range of ps, the outer bound and the inner bound do not 
coincide however, leaving room for improvement either of the outer bound or the schemes. 

V. Performance Analysis in the Presence of SNR Mismatch 

In this section, we study the distortions for the proposed schemes in the presence of SNR mismatch 
i.e., we consider the scenario where instead of knowing the exact channel SNR, the transmitter only 
knows a lower bound on the channel SNR. Specifically, we assume that the actual channel noise to be 
Z a ~ Af(0, N a ) but the transmitter only knows that N a < N so that it designs the coefficients assuming 
the noise variance is N. In what follows, we analyze the performance for both proposed schemes under 
the above assumption. 

A. Digital DPC Based Scheme 

Since the transmitter designs its coefficients for N, it aims to achieve the distortion D sep given in (fT7T) . 
It first quantizes the source to T by a Wyner-Ziv coding with side-information D* given in (fl"5T ) and then 
encodes the quantization output by a DPC with a rate 

*=ilog(l + ^j, (23) 

where P a is the power allotted to X a such that the distortion in the absence of SNR mismatch is minimized, 
i.e., 

D* 

P a = arg mf p—p- . (24) 

p 1 _|_ £_Z£k 

At receiver, since N a < N, the DPC decoder can correctly decode T with high probability. Moreover, 
the receiver forms the MMSE estimate of V from Y as V' a = (3 a Y with (3 a and the corresponding MSE 
D* a derived by substituting N a for N in (fl4l) and (fT5T) . respectively. After that, the problem reduces to the 
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Wyner-Ziv problem with mismatched side-information. In Appendix we show that for this problem, 
one can achieve 

D*D* a 

D sep,mis = D , D: ~ _ ^jj^Dsep- (25) 

Unlike the typical separation-based scheme that we have seen in 0, the proposed digital DPC scheme 
(whose digital part can be regarded as a separation-based scheme) can still take advantage of better 
channels through mismatched side-information. 

B. HDA Scheme 

Different from the digital DPC scheme, in the presence of SNR mismatch, the performance analysis of 
the HDA scheme cannot be converted to the Wyner-Ziv problem with mismatched side-information. It is 
because that in the HDA scheme, we jointly form an estimate of V from U and Y. Fortunately, as shown 
in O, the HDA scheme is capable of making use of an SNR mismatch. 

Similar to the digital DPC scheme, we design the coefficients for noise variance N. The HDA scheme 
regards D* as side-information and S' as interference. It generates the auxiliary random variable U given 
by ( fT8l) with coefficients described by (|22l) . Since iV a < N, the receiver can correctly decode U with high 
probability. The receiver then forms the MMSE as described in (fT9l) . Note that E[F 2 ] in A UY should be 
modified appropriately to address the fact that the actual noise variance is N a in this case. 

Remark 4: In (3), the authors compare the distortions of the digital scheme and the HDA scheme in 
estimating the source V and the interference S as we move away from the designed SNR. One important 
observation is that the HDA scheme outperforms the separation-based scheme in estimating the source; 
however, the separation-based scheme is better than the HDA scheme if one is interested in estimating 
the interference. Here, since the effective interference 5" includes the uncoded signal y/aV in part and 
the source is correlated to the interference, estimating the source V is equivalent to estimating a part of 
S'. Thus, one can expect that if P a and p are large enough, the digital DPC scheme may outperform the 
HDA scheme in the presence of SNR mismatch. One the other hand, if P a and p are relatively small, one 
can expect the reverse. 

Remark 5: Note that we have only discussed the case when the actual channel turns out to be better 
than that expected by the transmitter. On the other hand, when the channel deteriorates, the digital DPC 
scheme and the HDA scheme are not able to decode the digital part and the HDA part, respectively. 
For the digital DPC scheme, this is due to the fact that a capacity-approaching code is used so that the 
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decoding will fail if the channel is no longer being able to support this rate. For the HDA scheme, this 
inability to decode U is because the constraint (|2TT) is no longer satisfied if the channel is worse than 
that expected. However, both schemes can still form the MMSE estimate of the source from the received 
signal Y. Therefore, for a same choice of P a , the resulting distortion of two proposed schemes would be 
the same and is equal to D*. This implies that both the proposed schemes are able to provide graceful 
degradation when channel deteriorates. 

C. Numerical Results 

Now, we compare the performance of the above two schemes and the scheme that knows the actual 
SNR. The parameters are set to be Oy = erf = 1. We plot — 101og 10 (.D) as we move away from the 
designed SNR for both small (p = 0.1) and large (p = 0.5) correlations. Two examples for designed SNR 
= dB and 10 dB are given in Fig. [6] and Fig. [7J respectively. 

In Fig. |6l we consider the case that the designed SNR is dB which is relatively small compared to 
the variance of interference. For this case, we can see that which scheme performs better in the presence 
of SNR mismatch really depends on p. It can be explained by the observations made in Remark^and the 
power allocation strategy. For this case the optimal power allocation P a is proportional to p. For p = 0.1 
case, since the correlation is small and the assigned P a is also small, the HDA scheme is better than the 
digital DPC scheme. On the other hand, for p = 0.5 case, we allot a relatively large power to P a so that 
one may get a better estimate if we try to use the digital DPC scheme to estimate a part of 5". This 
property is further discussed in the Appendix [D] 

In Fig. [7J we design the coefficients for SNR = 10 dB which can be regarded as relatively large SNR 
compared to the variance of interference. For this case, the optimal power allocation P a for both p = 0.1 
and p = 0.5 are relatively small. Therefore, the performance improvement provided by the HDA scheme 
is larger than that provided by the digital DPC scheme for both cases. 

In Fig. [H we plot the performance of the proposed schemes with different choices of P a for the same 
channel parameters with those in the previous figure for p = 0.1. We observe that for both schemes, if 
we compromise the optimality at the designed SNR, it is possible to get better slopes of distortion than 
that obtained by setting P a = P a . In other words, we can obtain a family of achievable distortion under 
SNR mismatch by choosing P a G [0, P}. 
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VI. JSCC for the Generalized Cognitive Radio Channel 

An interesting application of the joint source-channel coding problem considered in this paper is in 
the transmission of analog sources over a cognitive radio channel. In this section, we will first formally 
state the problem, derive an outer bound on the achievable distortion region, and then propose a coding 
scheme based on the schemes given in Section HVl 

A. Problem Statement 

Recently, there has been a lot of interest in cognitive radio since it was proposed in |fl9ll for flexible 
communication devices and higher spectral efficiency. In a conventional cognitive radio setup, the lower 
priority user (usually referred to as the secondary user) listens to the wireless channel and transmits the 
signal only through the spectrum not used by the higher priority user (referred to as the primary user). 
In a generalized cognitive radio channel, simultaneous transmission over the same time and frequency is 
allowed. As shown in Fig. |9l the problem can be modeled as an interference channel with direct channel 
gain 1 and cross channels h\ and h 2 representing the real-valued channel gains from user 1 to user 2 and 
vice versa, respectively. The average power constraints imposed on the outputs of user 1 and 2 are Pi 
and P 2 , respectively. Different from interference channels, in cognitive radio channels, we further assume 
that the secondary user knows V\ non-causally. Here, we also assume that the channel coefficient hi is 
known by the secondary user. The received signals are given by 

Y 2 J \ h 1 J \ X 2 J \Z 2 J 

where Zi ~ A/"(0, 1) for % e {1,2}. The capacity region of this channel has been studied and is known 
for some special cases, e.g., the weak interference case [20] luTTI . the very-strong interference case [|22l . 
and the primary-decode-cognitive case 11231 . 

In this section, we consider the same generalized cognitive radio channel but our focus is on the case 
when both users have analog information V\ and V 2 , respectively. We are interested in the distortion region 
which describes how much distortion two users can achieve simultaneously. In particular, we consider the 
case when the two sources are correlated with a covariance matrix given by 

a Vi P°Vi°V2 

A ViV 2 — 
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The distortion measure is the MSE distortion measure defined in ©. An achievable distortion region 
can be obtained by first enforcing the primary user to use the uncoded scheme and using the proposed 
schemes given in section [IV] for the secondary user. In fact, since the primary user does not have any 
side-information, analog transmission is an optimal choice E4l ||25l in terms of the distortion achieved 
at the primary receiver. Further notice that since we do not consider SNR mismatch here, it makes no 
difference which proposed scheme we use. 

B. Outer Bound 

In this subsection, we derive an outer bound on the distortion region for the generalized cognitive radio 
channel with R\ = I(X™; Y™) and R 2 = I(X 2 ; Y 2 \X™). Then, for the primary user, we have 

| log ^ <<>,"; 

(b) 

< / W; 3?) 

= nR h (28) 

where (a) follows from rate distortion theory and (b) follows from the data processing inequality. Also, 
for the secondary user, we have 

^ < WWW) 



2 ° D 2 

( i I(V?;V?\V?,X?) 

® I(V 2 n ;V 2 n \X?) 
<I(X^Y 2 n \X?) 

= nR 2 , (29) 

where (a) is due to the fact that X" is a deterministic function of V™, (b) follows from the Markov chain 
V" -H- (X™,X 2 ) <H> (Y™,Y 2 ), and (c) follows from the data processing inequality. Thus, we have 

D obl = (30) 

D ob2 = V2 \ y \ (31) 
-n-2 

where (Ri, R 2 ) must lie inside the capacity region of the generalized cognitive radio channel. 
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As mentioned earlier, the capacity region of this channel setup is only known for some special cases. 
Fortunately, for those cases whose capacity regions remain unknown, outer bounds on (R X ,R 2 ) are 
available (see e.g. E31 wherein the authors give an unified view of outer bounds for different cases) 
and therefore we can still obtain the outer bound given in (1301 ) and (f3Tb . 

C. Proposed Coding Scheme 

Let the primary user simply transmit the scaled version of the uncoded source X x = P x /(Ty i V x . 
Therefore, the bottom channel in Fig. [9] reduces to the situation we considered in the previous section 
with source V = V 2 and interference S = h x X x . The covariance matrix becomes © with 

4 = 4 2 , (32) 
<r% = h\P x . (33) 

The secondary user then encodes its source to X 2 by the HDA scheme described previously in section HV-B I 
with power P 2 = Ph + P a an d coefficients according to ([221) . With these coefficients, the corresponding 
distortion D 2 is computed by (fT9i At the receiver 1, the received signal is 

Y 1 =X 1 + h 2 X 2 + Z x 

= (1 + (1 - ily/ahxh^) X x + h 2 X h + h 2 ^V 2 + Z x . (34) 

Decoder 1 then forms a linear MMSE estimate from Y x given by V x = (3 X Y X , where /3 X = E[V X Y X ]/E[Y X ] 
and 

E[V X Y X ] = (1 + (1 - 7)v^M 2 ) ^Pi<? 2 Vl + h 2 ^pa Vl a V2 (35) 
E^ 2 ] = (l + (l- 1 ) v ^h 1 h 2 ) 2 P 1 + ah 2 2l 2 a^ + 

h\P h + 2^Lh 2lP ^P 1 a 2 V2 (1 + (1 - l)^h x h 2 ) + N x . (36) 

Therefore, the corresponding distortion is D x = — ^EfViij]. 

It can be verified that assigning 7 = 1 may lead to a suboptimal D x in general. Thus, as we mentioned in 
Section ITV-A1 one may want to assign a non-zero power to transmit S in order to achieve a larger distortion 
region. We can then optimize the power allocation for particular performance criteria. For instance, if one 
desires achieving the minimum distortion for the secondary user, 7 should be set to be 1. However, if 
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the aim is to obtain the largest achievable distortion region, one should optimize over P a e [0, Pi] and 

7 G [0,1]. 

D. Discussions and Numerical Results 

Here, we give examples to compare the performance of the outer bound and the proposed coding 
scheme for two cases whose capacity region is known, namely the weak interference case and very-strong 
interference case. Also, similar to [|2Ti . we also present the distortion for the secondary user under the 
coexistence conditions. 

1. Weak interference case: When the interference is weak, i.e., \h 2 \ < 1, the capacity region is given 
by m El 



| .2 



i?1 -2 1 °H 1+ 1 + 
i? 2 <~log(l + (l-^)P 2 ), (37) 

where p x G [0, 1]. One can see that the capacity region of this case is a rectangle; therefore, increasing 
R 2 will not affect R 1 . For this case, the outer bounds in (1301) and (I3TI) become 

a 2 Vi 

D bi — ; — , (38) 

, www 

_ 4,(1 -p 2 ) 

D ° 62 - (39) 

One example of the distortion region for this case is shown in Fig. [T0]in which we plot the outer bound 
and the boundary of the distortion region achieved by the proposed coding scheme. The parameters are 
set to be = <7y 2 = 1, h\ = h 2 = 0.5, and the power constraints are P 1 = P 2 = 1. In this figure, 
One can observe that when p = 0, the outer bound is tight and the proposed coding scheme is optimal. 
However, the inner and outer bound do not coincide for other ps and one can see that the gap increases 
as p increases. 

2. Very-strong interference case: The channel is said to be in the very-strong interference regime if the 
following conditions are satisfied, 

\h 2 \ > 1, (40) 
\h iy /Pi/P 2 + l\ > WPi/Pi + h 2 l (41) 
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\h iy /P 1 /P 2 -l\ > \y/P 1 /P 2 -h 2 \. (42) 

The capacity region of this case is the union of (Pi,P 2 ) satisfying ll22l 

P 2 <~log(l + (l-p*)P 2 ) 
Ri + R2 < \ log (l + Pi + h\P 2 + 2p x h 2 y^P 2 ) 2 ^ , (43) 

where p x G [0, 1]. For this case, different choices of R 2 may lead to different upper bounds for Pi. Thus, 
the outer bound can be obtained by collecting all the Pareto minimal points of (D 1 , D 2 ) among all choices 
of (Pi, R 2 ) and p x . 

In Fig. [HI the outer bound and the boundary of the distortion region achieved by the proposed scheme 
are plotted. All the parameters are set to be the same as those in the previous figure except for hi = h 2 = 
1.5 now. It is easy to see that (I40l)-(l42l) are satisfied under these parameters. One can see that for this case 
the inner and outer bound do not coincide even for p = case. This may be due to the fact that in the 
proposed coding scheme, the primary decoder treats the signal from the secondary user as extra noise. 
This violates the insight of the very- strong interference regime that one should first decode interfering 
signal and then cancel it out since the interference is "very-strong" and is regarded as easier to decode. 
However, for the proposed scheme, the primary decoder is not able to obtain an improvement from this 
decoding strategy. This is because the digital part (or the HDA part, depends on which scheme is used) 
of the interfering signal is a function of V\ and the bin index (or U). Therefore, decoding the bin index 
(or U) only is not enough to reconstruct X d (or X h ). 

On the other hand, if one simply ignores the correlation and uses an optimal separate source-channel 
code at the secondary user, this coding scheme is guaranteed to achieve the outer bound for p = but 
this scheme is unable to adapt with p, i.e., the performance is fixed for all ps. Therefore, when p is large, 
one may obtain a lower distortion by using the proposed scheme although it fails to achieve the outer 
bound for any p. One example is given in Fig. [TT] that when p = 0.5, the distortion region achieved by the 
proposed scheme is larger than that achieved by an optimal separate coding scheme (whose performance 
is the same as the outer bound for p = 0). It is interesting to build a coding scheme that achieves the 
outer bound for p = and is capable of adapting with p for the very-strong interference case; however, 
this is beyond the scope of this paper. 

3. Coexistence Conditions: In GT1 . the coexistence conditions are introduced to understand the system- 
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wise benefits of cognitive radio. The authors study the largest rate that the cognitive radio can achieve 
under these coexistence conditions described as follows. 

1. the presence of cognitive radio should not create rate degradation for the primary user, and 

2. the primary user does not need to use a more sophisticated decoder than it would use in the absence 
of the cognitive radio, i.e, a single-user decoder is enough. 

Similar to this idea, we study the distortion of the secondary user under the following conditions 

1. the presence of cognitive radio should not create distortion increment for the primary user, and 

2. the primary user uses a single-user decoder. 

We present the outer bound and the signal-to-distortion ratio for the secondary user obtained by the 
proposed scheme under coexistence conditions. Here the outer bound is given by 

D b2 ,coexist 

inf D ob2 , (44) 

n <r v i 
obl — T+i\ 

where D obl and D ob2 are given in (1301) and (|3TI) . respectively, and Ri and R 2 therein can be further 
bounded by the capacity region or upper bounds on the capacity region as mentioned. Note that when 
taking the infimum, we simply constrain the distortion of the primary user to be at most the one achieved 
when there is no interference at all and ignore the second coexistence condition, i.e., this outer bound 
allows the primary decoder to be any possible decoder, not necessary a single-user decoder. 

In Fig. [12] and Fig. [T3l the achievable distortion for the secondary user is plotted for the same set 
of parameters as in Fig. [10] and Fig. [TT] respectively. As shown in these figures, the proposed scheme 
is able to increase the secondary user's signal-to-distortion ratio without degrading the performance of 
the primary user. Moreover, one can observe that at p = the proposed coding is optimal for the weak 
interference case but not for the very-strong interference case. This may be due to the fact that in the 
proposed coding scheme the interfering signal is not fully decoded. This may also be the consequence of 
ignoring the second condition when deriving the outer bound. Another interesting observation is that in 
Fig. [131 the signal-to-distortion ratio increases more rapidly than that in Fig. [12] This is because in the 
very-strong interference case, the channel would amplify the secondary user's signal much more than that 
in the weak interference case. So the secondary user could use less power to boost the primary signal 
such that the coexistence conditions are satisfied and then use the remaining power to decrease its own 
distortion. 
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VII. Conclusions 



In this paper, we have discussed the joint source-channel coding problem with interference known at the 
transmitter. In particular, we considered the case that the source and the interference are correlated with 
each other. We proposed a digital DPC scheme and a HDA scheme and showed that both two schemes can 
adapt with p. The performance of these two schemes under SNR mismatch are also discussed. Different 
from typical separation-based schemes which are not able to take advantage of a better channel SNR and 
suffer from abrupt degradation when the channel deteriorates, both the proposed schemes can benefit from 
a better side-information acquired at the decoder and also provide a graceful degradation and improvement 
under SNR mismatch. However, there is a difference between the performance of the two proposed schemes 
when SNR a > SNR^ and which scheme is better depends on the designed SNR and p. 

These two schemes are then applied to the generalized cognitive radio channel for deriving an achievable 
distortion region. Outer bounds on distortion region for this channel are also provided. To the best of our 
knowledge, this is the first joint source-channel coding scheme that has been proposed for the generalized 
cognitive radio channel. Numerical results suggest that, in the weak interference regime, the gap between 
the inner and outer bound is reasonably small for small and medium p and increases as p increases. 
Moreover, in the very-strong interference regime, there exist ps such that the proposed joint source-channel 
coding scheme outperforms optimal separate coding scheme. The system-wise benefits of cognitive radio 
in terms of distortion are also studied via imposing the coexistence conditions. 



In this appendix, we verify that with the knowledge of actual channel SNR, two proposed schemes 
perform exactly the same. For fixed 7 and P h = P — P a , the second term in (fT9l) becomes 



Appendix A 



Equivalence of CLU) and (IT9T ) 




E[VU] 



2 E[Y 2 } - 2E[VU}E[VY]E[UY] + E[VY} 2 E[U 2 } 
E[t/ 2 ]E[F 2 ] - E[UY] 2 



(45) 



where 



E[VU] = aE[S'V) + ko\ 



(46) 



E\VY] = E[S'V], 



(47) 



E[U 2 } = P h + a 2 E[S' 2 ] + K 2 a 2 v + 2«kE[SV] 



(48) 
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E[Y 2 ] = P h + E[S' 2 } + N, (49) 

E[UY] = P h + aE[S' 2 } + kE[S'V\, (50) 
with a and k 2 determined by (1221) and 

E[S' 2 } = a 7 V 2 + [1 + v^(l - 7)] V| + 2v^ 7 [l + - i)]pa v a s , (51) 

E[S'V] = s/E 1( j 2 v + [1 + v^(l - j))pa v a s . (52) 



After some algebra, we can rewrite the numerator and denominator in (1451) as, respectively, 

P h {E[S'V] 2 ND* + a 2 v P h (a 2 v E[Y 2 ] - E[S'V] 2 )} 
(P h + N)D* 

and 

P h {(ND* + P h a 2 )E[Y 2 } - P h E[S'V} 2 } 
(P h + N)D* 

Thus, we can rewrite (fl9l) as 

i4da = 0y - 1 A^yl = ay - 



jV(4E[F 2 ] - E[ffV] 2 ) 
(iVP* + P^ 2 )E[y 2 ] - PJE^'V] 2 
(a) jVP/*(a 2 E[Y 2 ] -E[SV] 2 ) 
~ (P, + iV)(4E[y 2 ]-E[5YP) 
P* 



1 + 3l' 

x T AT 



(53) 



(54) 



(55) 



where (a) follows from that P* = o 2 v - E[\/y] 2 /E[F 2 ] and E[VY] = E[S'V\. This completes the proof. 

Appendix B 
Digital Wyner-Ziv Scheme 

In this appendix, we summarize the digital Wyner-Ziv scheme for lossy source coding with side- 
information V (V — V + W with W ~ A/"(0, P*)) at receiver. Similar to the previous sections, we omit 
all the e and/or 5 intentionally for the sake of convenience and to maintain clarity. 

Suppose the side-information is available at both sides, the least required rate Rwz for achieving a 
desired distortion P is 

1 D* 

Rwz = -^og— . (56) 
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Let us set this rate to be arbitrarily close to the rate given in ([Tot , the rate that the channel can support 
with arbitrarily small error probability. The best possible distortion one can achieve for this setup is then 
given as 

D = IT^EK- < 57 ) 

N 

This distortion can be achieved as follows A3), 

1. Let T be the auxiliary random variable given by 

T = a sep V + B, (58) 

where 

D* - D 



a sep = \l ( 59 ) 



and B ~ jV(0, D). Generate a length n i.i.d. Gaussian codebook T of size 2 nI( - T ' v * > and randomly assign 
the codewords into 2 nR bins with R chosen from (fT6l) . For each source realization v, find a codeword 
t E T such that (v, t) is jointly typical. If none or more than one are found, an encoding failure is 
declared. 

2. For each chosen codeword, the encoder transmit the bin index of this codeword by the DPC with 
rate given in (fT6l) . 

3. The decoder first decodes the bin index (the decodability is guaranteed by the rate we chose) and 
then looks for a codeword t in this bin such that (t, v') is jointly typical. If this is not found, a dummy 
codeword is selected. Note that as n — > oo, the probability that t ^ t vanishes. Therefore, we can assume 
that t = t from now on. 

4. Finally, the decoder forms the MMSE from t and v' as v = v' + w with 



It can be verified that for the choice of a the required rate is equal to (1561) and the corresponding distortion 
is 



E[{V-V) 2 } =E[{W-W) 2 } 
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Appendix C 

Wyner-Ziv with Mismatched Side-Information 

In this appendix, we calculate the expected distortion of the digital Wyner-Ziv scheme in the presence 
of side-information mismatch. Specifically, we consider the Wyner-Ziv problem with an i.i.d. Gaussian 
source and the MSE distortion measure. Let us assume that the best achievable distortion in the absence of 
side-information mismatch to be D. The encoder believes that the side-information is V, and V — V'+W 
with W ~ N(0, D*). However, the side-information turns out to be V' a and has the relation V = V' a + W a 
with W a ~ N(0, D*). Under the same rate, we want to calculate the actual distortion D a suffered by the 
decoder. 

Since the encoder has been fixed to deal with the side-information, V, at decoder, the auxiliary random 
variable is as in (|58l) with the coefficient given in (l59l) . Since the decoder knows the actual side-information, 
V' a , perfectly, it only has to estimate W a . By the orthogonality principle, the MMSE estimate W a can be 
obtained as 

W = asepD * a (T-a V) (62) 

^sep a ' 

Therefore, the estimate of the source is V = V' a + W a . The corresponding distortion is given as 

D a = E[(V - Vf] = E[(W a - W a ) 2 } 
D*D* 

= ; — x — D (63) 

D*D* + (D* - D*)D 

Here, we give an example in Fig. [14] to see the performance improvement through having the access of 
a better side-information. In this figure, we plot the —10\og 10 D a as — 101og 10 L>* increases, i.e., as the 
actual side-information improves. The outer bound is obtained by assuming the transmitter always knows 
the distribution of actual side-information at decoder and the distortion of the HDA scheme is computed 
through derivations in section HV-Bl The parameters are set to be P = N = 1 and D* = 0.1. One can 
observe in the figure that both the schemes benefit from a better side-information at decoder. Moreover, 
it can be seen that these two schemes provide the same performance under side-information mismatch. 

Appendix D 
Discussions for SNR Mismatch Cases 

As discussed previously, both the digital DPC scheme and the HDA scheme benefit from a better SNR. 
Here, we wish to analyze and compare the performance for these two schemes under SNR mismatch. 
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Since the digital DPC scheme makes estimate from T (see Appendix [B]) and V (which is a function of Y) 
and the HDA scheme makes estimate from U and Y, it suffices to compare I(V; T, Y) with I(V; U, Y). 
By the chain rule of mutual information, we have 

I(V; T, Y) = I(V; Y) + I(V; T\Y), (64) 

and 

I{V- U, Y) = I(V; Y) + I{V- U\Y). (65) 

Thus, we only have to compare I(V; T\Y) to I(V; U\Y). Let us consider p = case for example, 

I(V; T\Y) = h(T\Y) - h(T\V, Y) 

= h(a sep V + B\Y)- h(a sep V + B\V, Y) 

= h(a sep V - a sep /3 a Y + B\Y) — h{a sep B\V, Y) 

= h(a sep W a + B\Y) - h(B) 

( = } h(a sep W a + B)- h(B) 
1 , al D* + D 

= 2 bg ^ ' (66) 

where a sep and W a are defined in Appendix O and (a) follows from the orthogonality principle. 

I(V; U\Y) = h{U\Y) - h(U\V, Y) 

= h{U\Y) - h(X h + aS' + kV\V, Y) 
= h(U\Y) -h((l- a)X h - aZ a \V, Y) 
> h(U\Y)-h((l-a)X h -aZ a ) 

1 nu^-nuYf/w] 

2 ° g (l-ayP h + a*N a • K ° ) 

where (a) follows from that conditioning reduces entropy and the equality occurs if there is no SNR 
mismatch. 

Two examples are given in Fig. [15] to compare these two quantities with and without SNR mismatch for 
a small and a large designed SNR, respectively. One can observe that without SNR mismatch, these two 
quantities coincide with each other for all choices of P a . This implies the result in section [IV] that without 
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mismatch the digital DPC scheme and the HDA scheme provide exactly the same distortion. However, 
with SNR mismatch, we can observe that which quantity is larger really depends on P a for the small 
designed SNR case. On the other hand for designed SNR = 10 dB case, we have I(V; U\Y) > I(V; T\Y) 
for a wide range of P a (except for some P a close to 1). This explains the results in section [V] that, for 
large designed SNRs, the HDA scheme has better results than the digital DPC scheme does while for 
small designed SNRs we cannot make this conclusion easily. 
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Fig. 1. Joint source-channel coding with interference known at transmitter. 
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Fig. 3. Digital DPC scheme. 
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Fig. 4. £ vs D, p = 0.3. 
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Fig. 6. SNR mismatch case for SNR = OdB. 




Fig. 7. SNR mismatch case for SNR = lOdB. 
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Fig. 8. Proposed schemes with different choices of Pa- 




Fig. 9. System model for a cognitive radio channel. 
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Fig. 12. Distortion region for the weak interference case under coexistence conditions, hx = h% = 0.5. 
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Fig. 13. Distortion region for the very-strong interference case under coexistence conditions, h\=h-2 = 1-5. 
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Fig. 14. Wyner-Ziv problem with side-information mismatch. 
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